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Retrieve all EM Definitions associated with 
the container group 

i 



For each EM Definition, examine the 
replication constraint object to determine the 
replication type and invoke a method that 
distributes the replicas according to 
replication type 
(See Fig 38-I) 

+ 

C End ) 

Fig 38-H 



Distribution Manager a hotStandbyReplicationDistributeEMReplicas , ' method 



Begin 



J 

A "active" node set is created by taking the 

union of all the node groups in all the 
replication groups included in the replication 
constraint associated with the EM Definition. 

i 

The "hotStandbyReplicationDistributeActiveEMs" 
method is invoked. (See Fig 38-J) 



j 

The "hotStandbyRepIicationdistributeBackupEMs" 
method is invoked. (See Fig 38-M) 



t 

Fig 38-I 
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Distribution Manager B hotStandbyReplicationDistributeActiveReplicas B method 
Begin 



Iterate overall Execution Module objects of 
the associated EM Definition. For each of 
them, perform the following steps: 




Yes ^ More 

execution modules^ 



( ) 



-Ne- 



1 



s 


Pick a node for the active replica 
(see Fig 38-K) 


* 




Pick a container for the active replica 
on the picked node (see Fig 38-L) 






Create execution module replica in 
the selected container 












Fig 38-J 



t* 
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Distribution Manager "hotStandbyReplicationPickNodeForActive" method 
Q Begin ^ 



Obtain the number of active replicas that are 
assigned to each node in. the "active- 
eligible" set 



The node with the lowest number of active 
replicas is selected 



( End ) 



Fig 38-K 



Distribution Manager "hotStandbyReplicationPickContainerForActive" method 



( Begin ^ 



Obtain the number of active replicas that are 
assigned to each container on the selected node 



I 



The container with the lowest number is 
selected 



( ) 



Fig 38-L 
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Distribution Manager "hotStandbyReplicationDistributeBackupRepiicas" method 



Begin ^ 





y 


f 




Iterate over all Execution Module objects of 
the associated EM Definition. For each of 
them, perform the following steps: 


► 




Pick a node for the backup replica 
(SeeFig38-N) 

i 



Pick a container for the backup replica 
on the picked node (See Fig 38-0) 



Create execution module replica in 
the selected container 




Fig 38-M 
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Distribution Manager "hotStandbyReplicationPickNodeForBackup" method 



C Begin ) 



For each node in the "active-eligible" set, 
determine the number of backup replicas 
associated with active replicas included in 
the node that includes the active replica of 
execution module associated with the 
backup replica that we want to create 



The node with the lowest number of backup 
replicas is selected 



Fig 38-N 

Distribution Manager "hotStandbyReplicationPickContainerForBackup" method 

Q Begin ^ 



Obtain the number of backup replicas that 
are assigned to each container on the 
selected node 



i 



The container with the lowest number is 
selected 



( ) 



Fig 38-0 
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( Begin ) 



System Management Tool Sends "Start Application" Request to 

JAC 



JAC Creates Application, EM Definition, Distribution Manager, 
and EM Distribition Policy Objects in State Model 



JAC Invokes the Distribution Manager "distribute" method 
(See Fig 38-A) 



Distribution Manager Creates Containers and Execution Module 

Replicas 

(See Figs 38-A through 38-0) 



( End ) 
Fig 39-A 



( Begin ^ 



JAC Determines that Application Needs more CPU Resources 



JAC "marks" the EM Definition objects in State Model to indicate 
to Distribution Manager that Application Needs more CPU 
Resources 



JAC Invokes the Distribution Manager "distribute" method 
(See Fig 38-A) 



Distribution Manager Creates a Container on an Unused Node 

and Assigns Some Execution Module Replicas to it 
(See Figs 38-A through 38-0) 



Fig 39-B 
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C Begin ) 



Execution Module Replica Fails 



Container Detects that a Replica of an Execution Module 
Failed 



i 



Container Sends "EM Failed" Message to JAC 




Promote a "Standby" 
Execution Module to "Active" 
role 



Mark Application 
As "Failed" 



JAC Reports EM Failure to System Management Tool 



JAC Invokes the Distribution Manager "distribute" method 
(See Fig 38-A) 



j. 



Distribution Manager Creates Replacement Replica 
(See Figs 38-A through 38-0) 



}[ 

( End ) 

Fig 40-A 
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Begin 



I 

Container Process Fails 



J 

NC Detects Process Failure 



J 

NC Sends "Process Failed" Message to EC 



v 



EC Marks Process Object "Failed" 



J 

EC Sends "Process Failed" Message to JAC 



J 

JAC Marks Container Object and All 
Included Replica Objects as "Failed" 



j 

JAC Reports Container Failure to System 
Management Tool 



If Necessary, JAC Promotes "Standby" Replicas to "Active" 

Role 



J 

JAC Invokes the Distribution Manager "distribute" method 
(See Fig 38-A) 

Distribution Manager Creates Replacement Container 
and Replicas (See Figs 38-A through 38-0) 



( End ) 

Fig 40-B 
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Q Begin ) 





r 


A Node Fails 



I 



Membership Protocol Detects Node Failure 



Node Controller Sends "Node Failed" Event Notification to Execution 

Controller 



Execution Controller Marks Node and Associated Process Objects as 

"Failed" 



Execution Controller Sends "Node Failed" Event Notification to 
Subscribers 

* — 



JAC Receives "Node Failed 8 Event Notification 



JAC Marks the Containers and all Execution Module Replica objects 
included in the failed Node as "Failed" 



If Necessary, JAC Promotes "Standby" Replicas to "Active" Role 



i 



JAC Invokes the Distribution Manager "distribute" method 
(See Fig 38-A) 

i 



Distribution Manager Creates Replacement Containers 
and Replicas (See Figs 38-A through 38-0) 



( " ) 



Fig40-C 
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NG1 








Nodel 




Node 2 




Node 3 




Node 4 




Node 10 












NG2 








Node 11 




Node 12 




Node 13 




Node 14 




Node 20 












NG10 








Node 91 




Node 92 




Node 93 




Node 94 




Node 100 



NG1 = (Node 1, Node 2, Node 3, Node 4 ... Node 10) 
NG2 = (Node 11, Node 12, Node 13, Node 14 .. Node 20) 

NG10 = (Node 91, Node 92, Node 93, Node 94 .. Node 100) 

RG1=(NG1,NG1) 
RG2 = (NG2, NG2) 

RG10 = (NG10, NG10) 

RC = (HotStandby : RG1, RG2, RG3, RG4, RG5, RG6, RG7, RG8, RG9, RG10) 

Fig 41 
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NodeB 




Auction-1 






(backup #1) 






Auction-2 






(backup #1) 






NodeE 



Catalog-1 
(active) 



Auction-2 
(backup #2) 



NodeC 

Auction-2 
(active) 




NodeF 



Auction-1 
(backup #2) 



NG = (Node A, Node B, Node C, Node D, Node E, Node F) 

R61 = (NG, NG) // Cardinality 2: 1 active + 1 backup 

RG2 = (NG, NG, NG) // Cardinality 3: 1 active + 2 backups 

RC1 = (HotStandby : RG1) 

RC2 = (HotStandby : RG2) 

Associate RC1 with Catalog EM Definition 

Associate RC2 with Auction EM Definition 



Fig 42 
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Node A 



Auction-1 
(active) 



NodeB 



NodeC 



Auction-1 
(backup) 




ReliableNG = (Node A, Node B) 

UnreliableNG = (Node C, Node D, Node E, Node F) 

RG1 = (ReliableNG, UnreliableNG) // 1 active + 1 backup 

RG2 = (UnreliableNG, UnreliableNG, UnreliableNG) // 1 active + 2 backups 

RC1 = (HotStandby : RG1) 

RC2 = (HotStandby : RG2) 

Associate RC1 with Auction EM Definition 

Associate RC2 with Catalog Definition 



Fig 43 
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Enclosure 1 



Ton 



Node A 



Auction-1 
(active) 



Power Supply 1 



NodeB 



Auction-2 
(backup) 



NodeC 




Enclosure1_NG = (Node A, Node B, Node C) 
Enclosure2_NG = (Node D, Node E, Node F) 
RG = (Enclosure1_NG, Enclosure2_NG) 
RC = (HotStandby : RG1) 
Associate RC with Auction EM Definition 



Fig 44 
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Node A 


Cell-1 
(active) 




Cell-2 
(backup) 






Dir-1 
(active) 




Dir-2 
(backup) 







Node B 



Cell-1 
(backup) 



Cell-3 
(active) 



Dir-1 
(backup) 



Dir-3 
(active) 





odeC 


Cell-2 
(active) 




Cell-3 
(backup) 






Dir-2 
(active) 




Dir-3 
(backup) 








NetlNG = (Node A, Node B, Node C) 
Net2NG = (Node D, Node E, Node F) 
RG1 = (NetlNG, NetlNG) 
RG2 = (Net2NG, Net2NG) 
RC1 = (HotStandby : RG1) 
RC2 = (HotStandby : RG1, RG2) 
Associate RC1 with Cell EM Definition 
Associate RC2 with Dir EM Definition 



Fig 45 
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NodeC 




Auction-1 
(active) 






Auction-4 
(backup) 




Network 



Node D 



Auction-2 
(active) 



Auction-1 
(backup) 




NodeE 



Auction-3 
(active) 



Auction-2 
(backup) 




Node F 



Auction-4 
(active) 



Auction-3 
(backup) 



DISKNG = (Node A, Node B) 
NODISKNG = (Node C, Node D, Node E, Node F) 
DISKR6 = (DISKNG, DISKNG) 
NODISKRG = (NODISKNG, NODISKNG) 
DISKRC = (HotStandby : DISKRG) 
NODISKRC = (HotStandby : NODISKRG) 
Associate DISKRC with Catalog EM Definition 
Associate NODISKRC with Auction EM Definition 
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Network 



NodeE 




Auction-1 






(backup) 






Auction-2 






(backup) 








NodeF 




Auction-3 






(backup) 






Auction-4 






(backup) 







NG1 = (Node A, Node B, Node C, Node D) 

NG2 = (Node E, Node F) 

RG = (NG1, NG2) 

RC = (ColdStandby : RG) 

Associate RC with Auction EM Definition 



Fig 47 
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Node A 

Auction-1 
(active) 



Cataiog-1 
(active) 




Node D 



Auction-4 
(active) 



Catalog-2 
(backup) 



Network 



1Z 



NodeE 



Catalog-3 
(active) 



Auction-1 
(backup) 



Auction-2 
(backup) 



NG1 = (Node A, Node B, Node C, Node D) 
NG2 = (Node E, Node F) 

NG3 = (Node A, Node B, Node C, Node D, Node E, Node F) 

RG1=(NG1,NG2) 

RG2 = (NG3, NG3) 

RC1 = (ColdStandby : RG1) 

RC2 = (HotStandby : RG2) 

Associate RC1 with Auction EM Definition 

Associate RC2 with Catalog EM Definition 



NodeC 

Auction-3 
(active) 




Catalog-2 




NodeF 



Catalog-3 
(backup) 



Auction-3 
(backup) 



Auction-4 
(backup) 



Fig 48 
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Java Application 






Controller 






(active) 
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Node 8 




Cell-H 






(active) 






Cell-G 






(backup) 






Fig 50 



Sheet 56 of 61 



Client Module 



Client Program 



Method invocation 



Stub 



EM ID 



ACRef 



Location cache 



EM ID 



5102 




Container 
Address 



5111 



5113- 



5101 
5116 
5110 



Request Execution 
Module Location 



Send Execution 
Module Location 



5112 



5114- 



510 



5115- 



Application Controller 



V 



State model 



Execution 
lodule 



Container 



Container 
Address 



Location 
Cache 
Reference 



Remote Invocation Request 



Node 



Container 



Execution module 



Operation 
Invocation 



Server 
object 



5106 
5105 

5104 
5103 



Fig 51 



Sheet 57 of 61 



C Begin J 
Client Program Invokes a Method on a Stub 



Obtain Execution Module ID From Stub 



Stub Accesses Location Cache Using 
Execution Module ID As Key 



Yes 



Stub Obtains Container Address 
from Cache Entry 




5201 
-5202 

-5203 



5204 5205- 



Stub Uses Container Address to 
Send Remote Invocation Request 
to Container ' 



Container Locates Server Object in 
the Execution Module y 



Container Invokes Operation on the 
Server Object y 




5209 



5210 



5211 



5206- 



5207- 



5208- 



No 



Container Send Operation Result I 
the Stub 



I 



Stub Returns the Result to the 
Client 



2 

End y> 



5212 



5213 



No 



1 



Client Module Sends Message to Application 
Pontroller Requesting Execution Module Location 



Application Controller Obtains the Network 
Address of the Container that Includes the 
Execution Module 



Application Controller Send Message to Client 
Module, the Message Including Container 
Address 



Client Module Enters the Execution Module ID and 
x Container Address into Location Cache 
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